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Invenforts) : Avrafmrn Oren, Yehuda Harbr.anj Yossi Fisher 



Titie of the invention 
Knowledge Tree Medical Ensiblement 



Field of the Inventicn 

The present invention relates to knowledge tree enablement within the 
p medical field mid more particulariy but not exclusively to knowledge tree enablement 

1 0 in the fisld of study Ing side elTectii of drugs, with particular reference to liver toxicity. 

■^y Background of the Invention 

Ph?!iTnareuticai;:i are required to undergo a demanding set of ciinicai trials in 
order 10 prove both rhat they work and that they work safely, that is witliout untoward 
:;0 15 ^ide dTscis. Ahci, different pharmaceuticals interact with each other so thar certain 

n drug combinations cannot safely be prescribed- Tlie interactions benveer; drugs are 

not widely understood and there is a tendency not to prescribe in any case of doubt. 

Clinical trials generally involve large numbers of patients and by their nature 
produce large amounts of data, "^The results of the trial are generally assessed and 
20 concliisions reached as to the safety and efficacy of the drug. 

However, analysis of large i^mounis of data is difficult. Each patient or 
volunteer participating in the trial has a rriedical history and it is difficult to spot 
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paiterns in the data that relate, for exampJa, to ^ parikylar item of mcdiceil histQry. 
Thus JT \$ mo known to use automaiic meiiiods of data mirtirig, iti which computers 
m liseci to £nd all the possible rekuoni^hip;> within a ddt^i set. Such aTi approach is 
utiheipfu] in the case of clinical trials since many trivial reJationships are found. 
5 Furthermore an enurmoLis amount of processirg power is required to run such data 
miriing, £LMd a large amount of human analysis is required afterwards to remove all of 
thetrivja] rfilationshlps and to cOT^centrate on the important data 



Sum mary of the Invention 

10 According to a first aspect of the present inveTition there is thus an automated 

.TOdeier for modehng of m interaciive system coniprisinfe at mt bioiogicai 
entity and at ieast one pharmac^itical substance, the sysi;tnTi compiising: 

a representation of states of the S}'-$tem, 

an input, asiiociattid with the representation for allowing users to define at 
15 ieast one of, the suites, expected relatiofisliips between the states and Independent 
inputs to the Slates, 

a 6m miner associated with the representation to operate on data taken from 
t^e system to apply the data to the states m accordance witii the defmcd relationships 
and inputs, thereby \o apply numencal values to the relationships and the inpuU, 
20 thereby to nt^dcl the inlsrac:ions. 

Preferably, the states mcludc beneficial actions of the phamaaceutical 
substance. 
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Additionally nr altcrnaiiveiy. the states J,nciude hartnflil actions of i>ie 
phamu^coutical substamce. 

Preferably. Oie v.iodd is usable to predict harmfLii irster^ictiotis of tJie 
phannaceirJ.c^i] aubsiujicc within the system* 

5 preterably. t!ie interaclions are berween at least one biological enrity and a 

p'uraliTY of pbarmaceutica! substances. 

Preferably, the iiK^ractions are between at least one pharmaceuMcal entity 
and a plurality of biological entities. 

Prafeiabiy, tlie data is clinscal trial data. 

iO Preferably the model 3S unable to direct a clinical trial 

Preferably, the model is usaWe to direct daig administration to a patient. 

Prefcirably the modal is tbrthar operable to ucixi a ^eccnd data set to calibrate 
the niodei, and a third datii sei lo test liic model. 

According to a second sispect of the present invention there is provided an 
)5 automated system for processing effects on iiver toKicitv of at least one 
pharmaceutioil substance in application to a bioloi^icai entity, the system con'^prising: 

:i isjprciscjstaion of states of "he applisifttion. 

an input associ^ed w.th the representation for allowing users to define 
^xpccs^^d lelSilignships between the states, Inaependciit iftputs to the states, 

^.0 a dim miner associated with tlie representation to operate on data uketi frora 

the appliL^^ttion to apply the data in accordance with the df^fined relationships and 



u\[m% thereby to appiy numerica] val^jes to the interactions imd the inputs, to model 
the application. 

Preferably, the applioatron comprises a plurality of pharmaceatical 
substances. 

5 According ro a third aspect of the pressfU invemion there is provided a 

systeni tor prodictirig Hkeiy liver to\.kity' as a side effect of application of a 
phamEaceutical substance, the system comprising: 

an Inpiit device for obtaining biood levels of ALT and AST respectively, 

5 cosjiparator, associated with the input device fot comparing the respective 
1 0 ievds of ALT mid ASI' produce a ratis of die levels, and 

a predictor associated batii w\ti\ the input device and the comparator, for 
predicting, from the levels and the ratio therebetween, a likelihood of development of 
liver toxicity, 

Preferably, the predictor is set tc conclude from low ALT and AST levels 
15 andaratio dose to l.thatalikehhood of development ofiivertoxjcityislow. 

Preferably, the predictor is set to conclude from high ALT arid AST levels, 
that a likelihood of liver toxjcit>' is relatively high. 

Preferably, the predictor is set to conclude from a ratio not close to 1, tha a 
likelihood of liver toxicit>' is relatively high. 

20 Preferably, th^; predictor is set to conclude from ^ ratio close to ], that a 

likelihood of liver inxicity is relatively low~ 
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A preferred cmbC'diTnent furJier comprises a 'aSreshoiJcr for serJn^^ a 
threshold likelihood, .ibove whicii application of the pharmaceutical substance h to be 
discontinued. 

AccorJing to a fourth aspect of the present inveniinn there is provided a 
5 method for siiodeling an Interaction bet:w$en at least one biological system and at kt\&i 
one pliarmaceutical substance, the method compfisina: 

building a diagram of the interaction, 

entering at kuf^i om of inputs to ihe states and ijiicractions between IJie 

1 0 cSetlnitig at least one output fvom at least one of the states, 

obtaining empirical 6m regarding the inter2i(::tion, 

cju"ryjng out data mining on ihe empirical data to assign at teast one of values 
to the relationships and funcdons to the states, ihereby to obtain a quanttelve model 
of the inctrAction. 

1 5 Preferably, the method comprises 

r^donsly divldrng liiie smpiric^il data set into at \em nvo data sets. 

pei forming the data mining using only one of the sers, and 

testing the niadel using a rainaining one of the sets to ensure that the data has 
not been overfitted. 

Brief Description of the Draw ings 
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For a better uriderstaflciing oi the mvention d^id to show how xhx ^mQ may 
be csJtied into effect reference will now be made, purely by way of example, to the 
accompan}/ing drawings, in which: 

irig. 1 h a :5jmplifieci diLtgram shoving a ffJodcUng tipparsttus acgordirg to a 

5 first eiTibodimcnt of the present invmicn. 

Fig, 2 }s d quaiimtive moud for studying liver ioxicity for V(se in the 
cmbodinieniofFig. 1, 

Fig. 3 is an fJtemativu qiulitative modal for studying liver loxicity ibr use in 
iheeir.hodiinent of Fig. ], 

*0 Fig- 4 iS a further ficxie tor addihon to either of the models of Fig. 3 or Fig. 4 

lot extending the made! to control af a climical trial, 

Fig. 5A if a graph showing the relationship between ALT AST liver 
t^r.irynci in the b'Ood, 

Fig. SB 15 a diagrajTE of knowlec!£,£ trtjc that incurporaies a limeiir 
1 5 reiatimship bemeen ^i:ic ALT and AST en2yine& a& inputs leading lo a diagnosis, and 
r ig. 5 2 Simplified ilovv chart r^towii^g a method of modeling an biteraction 
bctvx'een a hkiioglc^l entity and a pharmactruncal s^ibstance acccrdmg to an 
embodiment of trie present inve^mon. 



Description of the Preferred Einbodiincnts 
ReterfcfKe is m^ide to f% 1, which is a sii^iplified schematic diagram of 
an automated niodekr for modrliBg of an interactive system. interactive system 
10 composes a biological tntit>' and a pharmaceiiLical substance CeiYsrally, it b of 
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gi-eat interest to uaderstarid the interactions vvithir the system, so as to allow for safe 
use of the pharmacemical substance. The modeler h initially supplied with a state 
model 12 of the system 10, generally as a logical entity within a computer. The state 
model may be specific to the system being tested or it may be generalized for a certain 
*^ t>^pc of iysieiTi. Getierally^ the number of states is small at kai;t initially. A.s the 
probkm 15 considered funher it is generally broken down into smaller and smaller 
unhs. Thus the state model has a tendency to grow in size and the number of states 
ir^creases. initially, at an esirly stage of imderstandirig it is often easier to work with a 
small number of rsodes each having a large number of inputs and outputs, but as the 
10 model is rafmed, a larger nun^ber of nodes each reflect more direct causal 
^ relationships between a smaller number of inputs and outputs. The node? at this mere 

^0 advanced i^lage are easier to analyze !i\ terms of data mining and the system tiSnd$ to 

Q produce more accurate results. 

vP Each node -s preferably assigned a fi.mction that relates between inputs and 

^. 1 5 outputs. At the start a pr&sumed function may be ii$ed. For example a node may be 

defined for determinirtg the quantity of bilirubin k the blood. The^e are two types of 
bilirubin, direct bilirubin and indirect bilirubin, each of which i$ measured separMely. 
O Each of the uvo measurements are set as inputs to the node and a snmming function i5 

stt wkhm the nodu to give m oitrput indicative of the total amount of bilirubin. 

20 Initially the function is either guessed or is fiUed from the test data during the 

data mining procedure^ as wiil be discussed in more detail below. The function is 
^hen refmtd using empirical data in an operation of function fitting. The function is 
preferably refined with empincal data to steadily reduce the output variance. As will 
be discussed in n»ore detail bcbw, ovcrfltting of the fimclion is preferably avoided. 
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I'he smte mods! 12 compnses a representation of states of said system, but 
prefer.^bly daeA not initially include relai'ion^iiips therebetween, jnodt^i inpurs or 
quantities. 

The modeler further comprises knowJedge titc builder ]4, connected to the 
5 rsiprcsentau'on gr state model 12, for allowmg users to deiSne states in the model md 
expected relation sliips berv\'ceii the states and iiidependent inputs to the states. Tlie 
ide^i is that experts, peisons expected t& know aboui: the system, are selected and 
asked to deilne relationshipi between the states, and inputs to the states, that they 
believe to be sipjficant. Again^ at this ^tage, no atteinpt is made to quantily any of 
JO the relationships. The experts are simpJy asked to define reiationships that they 
bdicve, in the light of their experience, to exist 

ixi tht pressn: case, suitable experts may include phannticeutkal researchers 
familiar wiJti irhh of simihr drugs, and specialist medical praetitioicrs familiar with 
the condition that the pharmacetitica! substance tiirrentiy under test is intended to 
15 treat. It tould include paueits iTiVolved 111 ihe trkl if deemed appropriate. Generally 
it is regarded as advantageous to apply as wide a range of experience to the input 
stagfi of the modeling ai possible. 

The modeler preferably has a database 16 af quantified infon'nation 
regarding the system to be modeled. Traditional modeling system;s ba^ed on 
20 qi^antities of liata have attempted to find every possible relationship v^'iihin the data 
arid have tended to prcduce unwieldy modeli and require processing resuiirces out of 
ail proporticTs to the data avciilabk and rising exponentialiy with increases in the size 
of the database. 



A data miner 18 preferabJy operates in association with iiie rcpresemation 
and wilh ^ne datab^isc xo app!> values to the relationships. That is to s-ay the mode], 
with ex perl-defined relationships, is usiid as a guide to the data mining procs&s. 
The data mining process is thereby restricted lo tne study of relationships regarded by 
experts US important or relevant and in efTcct, a dimension redaction is achieved in the 
nsodeiing process. The rcsuit is a quamified model encompassing al! the states and a!i 
the Interactions therebetween thst have been previously decided to be Jinportant. A 
further redaction in the model mt.y then be carried oul by removing rfilationships 
vvhos^ quantities are found to be below a threshold value. Altemativct>' or 
additionally, relatioTi ships or inputs whose effect on an output is found to be 
regl igjbie, iiiay be removed. 

In a further stagt!. if the rnodel thus formed is foimd to be inadequate, the 
experts may be consulted again to find our if a relationship is missing. The 
qxiarjiification process may then be repeated with the new rebiiorisbjp. That is to say, 
when checking the data, the variance in the outputs is very large. In such a case a new 
relationship is preferably added to the model. 

Jletiirning to the questioa of function fitilngi in theory U is poj?f.]ble to 
produce a function of very high order which covers exactly every single data point in 
the Input. Such a fimction however is viewed as of limited predictive ability because 
it includes all tite noise in thtj origina) data. Using fumiOT^s of such high order is 
considered as overfirtiiig the function. In order to preveiit overfjtt'ng it is possible to 
randomly divide ^ne data inio three groups and to ut^e the fmi group for initial 
cpianilzation of the models th.e second group for calibration of the model ajid the third 
group dimply for testing the model. The third group it: not used to refine the model 



but shvply to ensurit that the variance uiomd ihe third graup is the same as with the 
other grcups, thertiby detenninipg that overfitting of The data has not occurred. 

Tht* syiitijm hcmg modeled k generally the interaction betwct^n one or more 
biological emities and one or more pnannaceutical substances. A particular faeiieftcial 
interaction mav tlie subject of the ctucly or a partscuiar harmful interaction, or the 
mode! may simply seek lo model the interactions as s whole. Once the model has 
been an^^dtd it may be used to predict possible irteraetions, Including side eiitecrsi, 
v^htu administeriid to a patient. For exampk the model may contain a relationship 
bctvveen age and a particular side etTcct of the drug. The prescribing physidzwi can 
therefore use the niodei to note that the danger of tlie side rffect is enhanced and 
guide both hiraself and the. patient to particular effects to watch out for (n partici^lar 
cases. The physician is also provided witii reliable infomiation on wtiich to base a 
decision that a particii^ar drug is too darg£;rous to prescribe for n given patient or that, 
contr^r) to previous belief, a certain drug is perfectly safe to give to a particuUr 
patient. The latter case may result, for example, from the ability of the model to relate 
a particular side effect to age Of £iny other patieni variable, which tht: physician is then 
able to ^ee is not applicable to his current patient. 

Tlie systiim may typically be used in a study of a single pharmaceutical 
substance used in numerous patients, that is to say its typical use is in modeling dat& 
from various stages of cUnicnl triais. Subsequently the model may be used as a 
predictor in tijs use of the substance c^t\ ijidividual patients. Of course the results of 
the treaimejit of the individuai psttent inay then be added to the database for 
snbsequent ssfinenicnts of the model. 
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\t is noted however, that the svstem may also be used for studying the use of 
a conibniiition of drugs on paiients. Gcneraiiy, in such a ca^e, itueraciions are poorly 
wjider^tood, ajid prescribing rules for drug interacticns gederaiiy assume the worst. 
That is to say, if there is a Ioiowti serious side effect af the particular drug 
5 combiriStion then the physician will usually be led to avoid prescTibing the 
combination in all circumstances, A predictive model that includes Interactions 
betweeri drugs may therefore scne as a nneans of allowing the prescription of a wider 
range of drug combination^^* 

Thz predictive power of the model may be used to direct a clinical trial. For 
10 exarsipte dai£t g*ithered up to a certain point may reveal that the drug is hamiful to 
J] patients over a cerfain ^ige, and thus the t-ial may bti snopped in respect of p^itients 

□ over that age but contliiued in respect of everyone else. Currently the tilais are most 

iskely to be stopped altogether, 

1^ A parliculaiiy praferred embodiment of the present iiivention uses a fir£:t set 

'^^ ] 5 of diita to build the model and then runs the model on a second set of datft to calibrate 

the model Preferabiy a third set of data if available, may be used to test the calibrated 
^0 model 

Reference h now made to Fig, 2, ^hich is a siinpfsfied diagram of a 
qiialiii^tive model for inessuring liver toxicity effects of a drug- Tnc model is the 
20 version after expert mpm but before data mining. The model contains tn-o nodes, a 
llrst liode 22 takes s^Tinptoms, signs and laboratory test results as input and produces 
m ouipui of "t>^pe of hepatic dysfunctioi''. A second node 24 receives the '"type of 
hepatic dysfunciion" an input, along with previous patient history, severity of 



Jl 



htphXk clinicaJ fimction and scrnm levels of the drug, and produces an output of 
'^polCTUiai for liver toxicity'*. 

The model of Fig. 2 is from the point of view of the irtdividuaJ patient, and 
aidicates a way of fixing the thought processes of tht L»xpen. The expert anaJ>zes the 
parieni dinical profile, which includes symptoms {siibjtictiv:^ description of ihe 
patient's feciinfs) signs (objective marks ot) the patiei^t's body) and labor^noo' ttisl 
result, as described above. Usiug the pati^nf s clinical profile the physician wouid 
uormally decide on The diagnosis. More specifically, tfie physiciaii may decide 
whether the patient has ajny hepatic dystection and refine the diagnosis conceding 
the livBT The above process is embodied in the knowledge tree of Fig. 2. 

TJie tnodei as described above is sufficient to guide a data n»inei utility to 
create a fomiijla for node 22. 

Similarly node 24 includes four inputs as showi, serum of the dmg, 
r>'pe ef hepatic dysfunction^ severity and previous history. The output of box 24 is the 
poremial for liver toxicity of the specific drug. Follovving a similar analysis using a 
data tnining utility the pharmacetitical company or prescnbing practitioner is supplied 
with considerable information regarding the safety or effjcncy of the drug. 

Beyond relationships within individual nodes, the model also supplies 
iiifonnation about relationships between t^od^s. Thus the output of first node 22 can 
be an input ro second node 24. The relationship between the two nodes is that 

of cause and effect, which i$ to say that the output of the first node is one of the 
causes or taputs of the second node. It is pointed out that a c£^use and effect 
relationship caii be exariiined in two ways, given a tatise I can predict an effect, but 
udditieniilly, given an effesi i cars use the tree to make assumpttons about the cause, 
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In the present ca^e. rrioving from a f\ml output of porential for liver toxicin^ one can 
determine ihe clinical llnding in ihc pciilcnithai warned of the toxicity. 

Reference is now made to Fig. 3, which is a simpliiied diagraiii of a variation 
of the ipode! of Fig. 2 Parts that are the same as those w previous figures are given 
5 the same reference numerals and are not describfc;d again except as necessary for an 
understanding of the present embed iir en t In ihe model of Fig. X ^ riew node is 
introduced, of which "*5erum levels of the drwg" is an outp-jt Three inpms of do$3ge, 
distribution features and dimiriation fcauires a/e defined as influences on ihe serum 
level, A pragressioft is shown between the models of Figs. 2 and 3 which progression 
10 is r>'pIcaJ of how a inode) progresses a? experts continue to del 'berate over it. 

Reference is tiow made to Fig. 4, which is a simplifjed diagram of etn 
extension that mav be made to eilljer of the models of Fig. 2 or Fig. 3, to allow the 
model to be used in the m^ageinent of a clinical trial The model includes a single 
node 2S which receives an input the output "potential for liver toxicit>''* of the 
15 models of Fig. 2 or Fig. 3. As additional inputs the node 28 is told about which phase 
of the trail is involved^ tlie type of liver tovic3t>\ and the severity of the liver toxicity. 
The inputs ajtr for the cilnical trial a whole. 

A series of ompiits ars defined us shown in the figure for managing the trail 
based on the information gEeaned, coatinue or stop the trial change drug dosage, new 
20 set of indications, new set of contraiiidications. change drug interactions, follow up 
patient more closely, and change environment. 

Reference is nou' made to Fig, 54, which is a graph showing a relationship 
lhat was discovered mtng the system of the previous embodiments and which can be 
useful for studying the :;bite of the liver. In Fig. 5 the relationship is shown between 
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avo liver enzymes, ALT and AST. Generally, levels of both ALT and AST .^re 
relatively lo\v in the bioodstreajn as llie en^^mes are retained in the liver. In the event 
of ti-auma irviihin the liver, and e^speciaMy in the event oi larger than normal scale 
death of \\\tr cells, iome of the enzyme escapes into the blood. Thus., the presence of 
5 notsceabie levels of uitner of the sbov^ enz>mes has bten used m the past as an 
indicatoi of liver toxicity Indeed in Fig. 5, the va^t irajorit^* of points piotted are 
iiose to the origin of the graph, la applying Uie above embodiments to the liver 
system it h;/poihesized that a linear relationship existed betw&eo the iwo 
i^^y^Tles. In any ca.se a ceiriain hnearity can be seen in the graph. 

10 The ruodel found that there is indeed a linear relationship between iihc t\^''0 

substances, bvX that the linearity is stronger in the case of hsalthy patients than in 
paritinu already known to be suffering from liver dysfunction. Thus, the potential for 
liver dy.™ncticn m£,y be predicted by monitonng. not only the overall Jevek of AST 
and ALT, hut also ihe extent of the liriearlty in the ralarionsiiip therebetv^scn. 

15 For cximple a point numbered 33 bc&ted in the top right hmd comer of the 

graph has high levels of both enzymes and would traditionally have been indicated as 
a sign of illness. Ivevenheless the relationship is here shown to be linear, indicating 
ihat the illness is not serious. By condXiSt a point numbered 82 in the lower right part 
of the ^^aph is very n jn iirtear, indicating serious liver dysfunction. 

20 The four numbered points 1202, 1039, 4S5 and 1664, around the periphery of 

the lower ^cft region of the gr-aph would trtiditionally have been regarded as being 
healthy on the grounds that neither enzynie is outside d^e linriit. Hovvever linearity- is 
clearly low and ihe present embodiment preferably signals the presence of hver 
disorder. 
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The Aho^c prediction tnay be; iTiccrpoi*ared Into a model as described with 
resDecL to Pig. 4 for conducting a clinical rrial. It may also be incorporated into an 
indiv'dua! f^atiem i-nod^jl of the fcii^d shown in Figs. 2 and 3. Trie model jnay be 
connected directly to m input device for reading in AST and ALT k\dA. Once the 

5 mode] has been quantized it wsll g^rneraliy include a node whose outputs are defined 
SD that ihey d'fcctsvely compare the levHs of the two drugs. If departure irom 
jmearit)^ h detected then a difigtiosis of Jiver disorder may be given. A knov^iedge 
Tree which includes the eniyine Isvisls as inputs and gives a diagnosis as an output is 
^howT) m Fig. 5B. Gtinerally, the quantitying st^ge may fod new relationships 

i\) beuveen variables or attach greater or lesser iniportance to previously known or 
siispected relationships, which casi now b£ incorporated into new models. 

!t IS also possible to build a dedicated device foe applying to a paticm to 
obtain an indication of livtr toxicity. The dedicated device preferably comprises an 
input d2vice for niea^itring AST and ALT levels and a processor includes companson 

15 circuitry for produciag a ratio. The processor pretferably also includes analysis, or 
predictor, functionaiity which uses eitbi^r or both of the absolute values and ihe ratio 
Detv\een to decide en the potential for liver loxlcity. For example the predictor may 
be set to conclLide frorr_ low AlT and AST levels and departure Itom the linear 
relationship, that a likelihood of development of liver toxicity is low. Likewise the 

20 predictor may be set to conclude from high ALT and AST levels. Uiax a likelihood of 
HKi tOKtcit)' is relarively high. Agsin, th=: predictor may be ^iet to conclude from 
departure trcn linearity, without reference lo absolute levels, that a likelihood of liver 
toxicity' ts reiativeiv high. Likewise, ihe predictor may be set to conclude trom a ratio 
close to linearity, without reference to absolute levels, th-^t a likelihood of liver 

25 toxicity is relatively low. In a prefen'ed embodimeni, a thresholder may be included 
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HI The predictor for setting a thrssliold likelihood, above which application of the 
phamiticeuticai substance to be discontinued as btlr\g too dangerous. The tlirsshoid 
is preferably akerud for different substances and for different ailinetits. For example a 
drug being ui;ed in a Ijfc-LhreaTenirg ailment is (preferably assigned & high threshold 
5 for discontinviity whereas a drug th£t is being used for a chronic but 3ow level 
coTsdition mav be given a lower threshold for discontinuity. 

Referctice is now made to Fig. 6^ whiuh is a simpHfied flow chmt describing 
a method of modeling an interactian between a phannacentical jsitbstance and a 
i3iological system fjccording to a preferred embodiment of ihe present invention. 

10 in Fig. 6 a first stage of airanging a state diagram of the interaction to be 

Tiiodeied is carried out. Then a $tage of bidding interaction^ batwsen the states and 
inputs to the states is carried out. At least one output is also preferably defined, Tne 
above stages are prefe.-^bly carried oui i:smg n kno'^^^dge tree builder as described 
above. A data set, preferably including empiricaJ data is ta'fceri to feed a data mining 

15 piocedLre which studies the data for the interactions indicated in the model, A 
quantified model of the interaction h thereby attsined. Standard experimental 
prdsjcdufB provides that ihe data is divided into three, preferably at random. One of 
tlie dAu sets is ihen used for data mining, one of the data sets is used for calibration 
and one of the data sets is used for te5ti!ig the daxa to ensure That overfitling of the 

20 data has iiul occurred. 

Jt is appreciated that certain features of the invention, which are, for clarity, 
described in the cofltexl of sepaixite ernDodiments, may also be providtd in 
i:ombination in a single embodiment Coxiversely, various features of the invention 
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whicfi are, for brtjvity, described in the context of a single embodiment, may also he 
provitled sepArateiy or in any suitable subcombination. 

It w)]] be appreciated by persons skilled in ihe art that thu presemt invoition is 
not limited to whuit has been particiilariy shown and described heri2inabove. Rather 
5 the scope of the present invention is defined by the appended claims and mcli^des both 
conibinai-ions and subcombinations of t^ie varioiis features described hereinabove as 
well as variiitions m6 modlfimiom thereof which would occur to persons rikilJcd in 
the art upon reading the foregoing description. 
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